User-Defined Gestures with Physical Props in Virtual Reality

When interacting with virtual reality (VR) applications like CAD and open-world games, people may want to use gestures as a means of leveraging their knowledge from the physical world. However, prefer props over handheld controllers input in VR. We present an elicitation study where 21 participants chose 95 perform manipulative for 20 CAD-like game-like referents. analyzing this data, we found existing methods studies were insufficient describe props, or measure agreement prop selection (i.e., between sets items). proceeded by describing context-free grammars, capturing how different used similar roles given gesture. gesture scores using generalized score that developed compare multiple selections rather than single selection. selected based on resemblance objects actions they afforded; depended referent, some referents leading choices, while others led choices; small set carefully chosen can support gestures.